Papers with Wikipedia pages
Improving Candidate Generation for Low-resource Cross-lingual Entity Linking (2020.tacl-1)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual entity linking (XEL) do not extend well to low-resource languages with few Wikipedia pages. |
| Approach: | They propose to improve the model by combining Wikipedia references with a list of plausible candidate entities. |
| Outcome: | The proposed method yields 16.9% in Top-30 gold candidate recall compared with state-of-the-art models. |
Entity Resolution and Location Disambiguation in the Ancient Hindu Temples Domain using Web Data (N18-5)
Copied to clipboard
| Challenge: | Existing systems for resolving entities and disambiguating locations based on publicly available web data are challenging because of the limited information available on the Web. |
| Approach: | They propose a system for resolving entities and disambiguating locations based on publicly available web data in the domain of ancient Hindu Temples. |
| Outcome: | The proposed system resolves entities and disambiguates locations with high confidence using grammar rules and clustering algorithms. |
Stretching Sentence-pair NLI Models to Reason over Long Documents and Clusters (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in modeling and datasets demonstrate promising performance for NLI. |
| Approach: | They explore the direct zero-shot applicability of NLI models to real applications . they analyze the robustness of models to longer and out-of-domain inputs . |
| Outcome: | The proposed models are robust to longer and out-of-domain inputs and can perform on full documents. |
Learning to Link Grammar and Encyclopedic Information of Assist ESL Learners (P19-3)
Copied to clipboard
Jhih-Jie Chen, Chingyu Yang, Peichen Ho, Ming Chiao Tsai, Chia-Fang Ho, Kai-Wen Tuan, Chung-Ting Tsai, Wen-Bin Han, Jason Chang
| Challenge: | Linggle Booster provides rich lexical information such as collocations and grammar patterns for target words. |
| Approach: | They propose a system that takes an article, identifies target vocabulary, provides lexical information, and generates a quiz on target words. |
| Outcome: | The proposed system has been evaluated on a set of target words and has a good performance. |
Men Are Elected, Women Are Married: Events Gender Bias on Wikipedia (2021.acl-short)
Copied to clipboard
| Challenge: | Disproportional event distributions can manifest and amplify social stereotypes . researchers have been using NLP tools to analyze corpora for various tasks on online platforms. |
| Approach: | They propose to scrape a corpus of career and personal life descriptions with demographic information from 10,412 celebrities to facilitate the study. |
| Outcome: | The proposed model detects gender biases in a corpus of career and personal life descriptions and calibrates the results using strategically generated templates. |
X-PARADE: Cross-Lingual Textual Entailment and Information Divergence across Paragraphs (2024.naacl-long)
Copied to clipboard
| Challenge: | X-parade is the first cross-lingual dataset of paragraph-level information divergences and entailments . ability to recognize differences in meaning underlies many NLP tasks . |
| Approach: | They propose a cross-lingual dataset of paragraph-level information divergences . they use a dictionary to identify new or inferred information in Wikipedia pages . |
| Outcome: | The proposed dataset shows that the proposed methods fail to handle inferable information . the dataset contains fine-grained span-level annotations for content in different languages . |
A Multilingual Wikified Data Set of Educational Material (L18-1)
Copied to clipboard
Iris Hendrickx, Eirini Takoulidou, Thanasis Naskos, Katia Lida Kermanidis, Vilelmini Sosoni, Hugo de Vos, Maria Stasimioti, Menno van Zaanen, Panayota Georgakopoulou, Valia Kordoni, Maja Popovic, Markus Egg, Antal van den Bosch
| Challenge: | a crowdsourcing effort to annotate and link parallel texts has been unsuccessful . a data set of parallel texts in eleven languages is presented . |
| Approach: | They present a wikified data set of English sentences linked to Wikipedia pages . they use crowdsourcing to annotate the texts and perform crowdsourcing for complex annotations . |
| Outcome: | The proposed data set is valuable as it constitutes a rich resource . it includes annotated data of English sentences linked to translations in eleven languages . |
HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language Generation (2022.acl-long)
Copied to clipboard
Zhoujun Cheng, Haoyu Dong, Zhiruo Wang, Ran Jia, Jiaqi Guo, Yan Gao, Shi Han, Jian-Guang Lou, Dongmei Zhang
| Challenge: | Existing studies on table reasoning focus on flat tables and hierarchical tables . a new dataset, HiTab, aims to examine numerical reasoning over hierarchic tables based on hierarchically structured tables - a strong challenge for existing baselines and a valuable benchmark for future research. |
| Approach: | They propose a hierarchical question answering and natural language generation dataset to study hierarchic tables. |
| Outcome: | The proposed model shows that it is effective in QA and natural language generation over hierarchical tables. |
A Submodular Feature-Aware Framework for Label Subset Selection in Extreme Classification Problems (N19-1)
Copied to clipboard
| Challenge: | Experimental results show that extreme multi-label learning improves label prediction quality by 3% to 5% in three of the 5 tasks and is competitive in the others. |
| Approach: | They propose a submodular maximization framework with linear cost to find informative labels which are most relevant to other labels yet least redundant with each other. |
| Outcome: | The proposed model improves label prediction quality by 3% to 5% in three of the 5 tasks and is competitive in the others. |
AttentiveChecker: A Bi-Directional Attention Flow Mechanism for Fact Verification (N19-1)
Copied to clipboard
| Challenge: | Existing fact-checking datasets do not provide manual annotations for sentence-level evidence. |
| Approach: | They propose a task-agnostic pipelined system that extracts textual evidence that supports or refutes a factual claim from Wikipedia pages. |
| Outcome: | The proposed system achieves state-of-the-art results on the FEVER dataset. |
Revisiting Document Representations for Large-Scale Zero-Shot Learning (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing methods for visual recognition use visual attributes carefully annotated by humans. |
| Approach: | They propose a semi-automatic mechanism for visual sentence extraction that leverages document section headers and clustering structure of visual sentences. |
| Outcome: | The proposed method improves on the ImageNet dataset with 10,000 unseen classes. |
Answering Open-Domain Questions of Varying Reasoning Steps from Text (2021.emnlp-main)
Copied to clipboard
| Challenge: | a new benchmark is developed to answer open-domain questions from text . the system uses a single multi-task transformer model to perform all the necessary subtasks . |
| Approach: | They develop a unified system to answer directly from open-domain questions . they use a single multi-task transformer model to perform all the necessary subtasks . |
| Outcome: | The proposed system can answer open-domain questions on any text collection without prior knowledge of reasoning complexity. |
GM-RKB WikiText Error Correction Task and Baselines (2020.lrec-1)
Copied to clipboard
| Challenge: | GM-RKB WikiText Error Correction Task for automatic detection and correction of typographical errors in Wikitext annotated pages. |
| Approach: | They propose to use a GM-RKB semantic wiki to automatically detect typographical errors in WikiText annotated pages. |
| Outcome: | The included corpus is based on a snapshot of the GM-RKB domain-specific semantic wiki consisting of a large collection of concepts, personages, and publications . Numerous Wikipedia pages were also included as additional training data in the task’s evaluation process. |
Clue-Instruct: Text-Based Clue Generation for Educational Crossword Puzzles (2024.lrec-main)
Copied to clipboard
| Challenge: | Educational crosswords are characterized by less cryptic and more factual clues than traditional puzzles. |
| Approach: | They propose to use a dataset to generate educational clues for Large Language Models (LLMs) they use Wikipedia to gather information associated with relevant keywords and use it to generate clues. |
| Outcome: | The proposed approach generates educational clues from a dataset containing 44,075 examples with text-keyword pairs associated with three distinct crossword clues. |
Resource of Wikipedias in 31 Languages Categorized into Fine-Grained Named Entities (2022.coling-1)
Copied to clipboard
| Challenge: | a resource of Wikipedias in 31 languages is categorized into Extended Named Entity (ENE) ENE version 8 has 219 fine-grained NE categories. |
| Approach: | They describe a resource of Wikipedias in 31 languages categorized into Extended Named Entity (ENE) they first categorized 920 K Japanese Wikipedia pages using machine learning, then shared a task of Wikipedia categorization into 30 languages . |
| Outcome: | The proposed system is based on a dataset of Japanese Wikipedia pages . the dataset shows the best performance among the 30 languages . |
StRE: Self Attentive Edit Quality Prediction in Wikipedia (P19-1)
Copied to clipboard
| Challenge: | Existing methods for content moderation and review rely on page reputation, editor activity or rule based heuristics. |
| Approach: | They propose a self-attentive revision encoder which leverages orthographic similarity of lexical units toward predicting the quality of new edits. |
| Outcome: | The proposed model outperforms existing models by at least 17% and at most 103% on a set of 21M revisions across 32K Wikipedia pages. |
Evidence Retrieval for Fact Verification using Multi-stage Reranking (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing evidence retrieval methods are limited by single-stage evidence extraction. |
| Approach: | They propose to use a multi-stage reranking paradigm to enhance the fact verification process by increasing the recall of sentences by 7.85%, tables by 8.29% and cells by 3% compared to the current state-of-the-art. |
| Outcome: | The proposed system outperforms state-of-the-art models and achieves a 93.63% recall rate for Wikipedia pages. |
Generating Fact Checking Briefs (2020.emnlp-main)
Copied to clipboard
Angela Fan, Aleksandra Piktus, Fabio Petroni, Guillaume Wenzek, Marzieh Saeidi, Andreas Vlachos, Antoine Bordes, Sebastian Riedel
| Challenge: | Existing work has framed fact checking as classification, often supported by a claim as input. |
| Approach: | They propose to use natural language briefs to increase the accuracy of fact checking . they show that QABriefer increases the accuracy by 10% while QABries reduce time . |
| Outcome: | The proposed model increases the accuracy of crowdworkers by 10% while reducing the time required by 20%. |
One Document, Many Revisions: A Dataset for Classification and Description of Edit Intents (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing methods to understand revisions have failed to provide a deeper understanding of the nature of these edits. |
| Approach: | They propose to use a Wikipedia revision history dataset to train a classifier that achieves a 90% accuracy in identifying edit intent and a distantly-supervised model that generates . |
| Outcome: | The proposed model achieves 90% accuracy in identifying edit intent and a best score of 28 ROUGE. |
RikiNet: Reading Wikipedia Pages for Natural Question Answering (2020.acl-main)
Copied to clipboard
| Challenge: | Using Wikipedia pages to answer open-domain questions remains challenging in natural language understanding. |
| Approach: | They propose a model which reads Wikipedia pages for natural question answering . it uses a dynamic paragraph dual-attention reader and a cascaded answer predictor . |
| Outcome: | The proposed model outperforms the human model on the Natural Questions dataset . it achieves 74.3 F1 and 57.9 F1 on long-answer and short-answer tasks . |
A Synthetic Data Generation Framework for Grounded Dialogues (2023.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to train grounded dialogues require large amounts of data. |
| Approach: | They propose a synthetic data generation framework for grounded dialogues that takes knowledge data and heuristics to determine a dialogue flow and incrementally turn it into a dialog. |
| Outcome: | The proposed framework significantly boosts model performance in training data and low-resource scenarios. |
Synthetic Textual Features for the Large-Scale Detection of Basic-level Categories in English and Mandarin (2021.emnlp-main)
Copied to clipboard
| Challenge: | Basic-level categories are an important psycholinguistic concept introduced by Rosch et al. . an at-scale algorithm for the automatic determination of BLC exists, but it operates without Rosch-style semantic features. |
| Approach: | They propose a method for the detection of BLC at scale that makes use of Rosch-style semantic features. |
| Outcome: | The proposed method outperforms the current SoA in detecting basic-level categories with an accuracy of 75.0% in English and 80.7% in Mandarin. |
CORE: A Few-Shot Company Relation Classification Dataset for Robust Domain Adaptation. (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing datasets that focus on company relations and business entities are lacking in relation classification. |
| Approach: | They introduce a few-shot relation classification dataset for company relations and business entities . they use a dataset that includes 4,708 instances of 12 relation types . |
| Outcome: | The proposed dataset includes 4,708 instances of 12 relation types with corresponding textual evidence extracted from company Wikipedia pages. |
HelloFresh: LLM Evalutions on Streams of Real-World Human Editorial Actions across X Community Notes and Wikipedia edits (2024.findings-acl)
Copied to clipboard
Tim Franzmeyer, Aleksandar Shtedritski, Samuel Albanie, Philip Torr, Joao F. Henriques, Jakob Foerster
| Challenge: | a better understanding of LLM capabilities on real world tasks is vital for safe development and deployment. |
| Approach: | They propose a new LLM called HelloFresh that uses real-world data to measure performance . they backtest the model and find it yields a temporally consistent ranking . |
| Outcome: | The proposed benchmarks outperform static evaluation data and test data on Wikipedia pages. |
Pre-training Cross-lingual Open Domain Question Answering with Large-scale Synthetic Supervision (2024.emnlp-main)
Copied to clipboard
| Challenge: | Cross-lingual open domain question answering requires multiple models, requiring substantial annotated datasets and auxiliary resources to bridge between languages. |
| Approach: | They propose a selfsupervised method that exploits Wikipedia's cross-lingual link structure . they show that the method outperforms comparable methods on supervised and zero-shot settings . |
| Outcome: | The proposed method outperforms comparable methods on supervised and zero-shot language adaptation settings. |
GameWikiSum: a Novel Large Multi-Document Summarization Dataset (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing datasets contain only hundreds of samples, resulting in heavy reliance on hand-crafted features or manually annotated data. |
| Approach: | They propose a new domain-specific dataset for multi-document summarization that is 100 times larger than commonly used datasets. |
| Outcome: | The proposed dataset is 100 times larger than commonly used datasets and in another domain than news. |
DynaQuest: A Dynamic Question Answering Dataset Reflecting Real-World Knowledge Updates (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are typically trained on static datasets, preventing them from integrating real-time updates. |
| Approach: | They propose a dynamic question-answer answering dataset reflecting real-world knowledge updates that are automatically compared between Wikipedia versions and generating question-anchor pairs based on these updates. |
| Outcome: | The proposed framework improves LLMs' performance on time-sensitive question answering by maintaining a dynamic knowledge updating process. |